InfiniteNature-Zero: Learning Perpetual View Generation of Natural Scenes from Single Images
نویسندگان
چکیده
We present a method for learning to generate unbounded flythrough videos of natural scenes starting from single view. This capability is learned collection photographs, without requiring camera poses or even multiple views each scene. To achieve this, we propose novel self-supervised view generation training paradigm where sample and render virtual trajectories, including cyclic paths, allowing our model learn stable views. At test time, despite never having seen video, approach can take image long trajectories comprised hundreds new with realistic diverse content. compare recent state-of-the-art supervised methods that require posed multi-view demonstrate superior performance synthesis quality. Our project webpage, video results, at https://infinite-nature-zero.github.io .
منابع مشابه
Plant Classification in Images of Natural Scenes Using Segmentations Fusion
This paper presents a novel approach to automatic classifying and identifying of tree leaves using image segmentation fusion. With the development of mobile devices and remote access, automatic plant identification in images taken in natural scenes has received much attention. Image segmentation plays a key role in most plant identification methods, especially in complex background images. Wher...
متن کاملInferring Depth from Single Images in Natural Scenes
The inverse optics problem is one of the oldest and most well known problems in visual perception. Inferring the underlying sources of visual images has no analytic solution. Recent work on brightness, color, and form has suggested that visual percepts represent the probable sources of visual stimuli and not the stimuli as such, suggesting an empirical theory of visual perception. Here I explor...
متن کاملLearning to Estimate Scenes from Images
We seek the scene interpretation that best explains image data. For example, we may want to infer the projected velocities (scene) which best explain two consecutive image frames (image). From synthetic data, we model the relationship between image and scene patches, and between a scene patch and neighboring scene patches. Given a new image, we propagate likelihoods in a Markov network (ignorin...
متن کاملAutomatic 3D view Generation from a Single 2D Image for both Indoor and Outdoor Scenes
Image based video generation paradigms have recently emerged as an interesting problem in the field of robotics. This paper focuses on the problem of automatic video generation of both indoor and outdoor scenes. Automatic 3D view generation of indoor scenes mainly consist of orthogonal planes and outdoor scenes consist of vanishing point. The algorithm infers frontier information directly from ...
متن کاملVIEW GENERATION FOR 3 - D SCENES FROM VIDEO SEQUENCESNelson
This paper focuses on a representation for 3-D scenes consisting of dense depth maps at preselected viewpoints from video sequences derived from unknown but approximately horizontal motion. In contrast to existing methods that construct a full 3-D model or those that exploit geometric invariants, an intensity-depth representation is used to generate arbitrary views of the 3-D scene. Speciically...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Lecture Notes in Computer Science
سال: 2022
ISSN: ['1611-3349', '0302-9743']
DOI: https://doi.org/10.1007/978-3-031-19769-7_30